منابع مشابه
Inverse Limits with Generalized Markov Interval Functions
In [8] Markov interval maps were introduced and it was shown that any two inverse limits with Markov interval bonding maps with the same pattern were homeomorphic. In this article we introduce generalized Markov interval functions, which are a generalization of Markov interval maps to set-valued functions, and show that any two generalized inverse limits with generalized Markov interval bonding...
متن کاملTilings, Scaling Functions, and a Markov Process
We discuss a class of Markov processes that occur, somewhat unexpectedly, in the construction of wavelet bases obtained from multiresolution analyses (MRA). The processes in question have been around for a long time. One of the first references that should be cited is a paper by Doeblin and Fortêt [10] (1937), entitled “Sur les chaînes à liaisons complètes”. In English, they are sometimes calle...
متن کاملThe value functions of Markov decision processes
We provide a full characterization of the set of value functions of Markov decision processes.
متن کاملInverse Limits with Countably Markov Interval Functions
We introduce countably Markov interval functions and show that two inverse limits with countably Markov interval bonding functions are homeomorphic if the functions follow the same pattern. This result presents a generalization of results of S. Holte, and I. Banič and T. Lunder.
متن کاملMarkov Decision Processes with General Discount Functions
In Markov Decision Processes, the discount function determines how much the reward for each point in time adds to the value of the process, and thus deeply a ects the optimal policy. Two cases of discount functions are well known and analyzed. The rst is no discounting at all, which correspond to the totaland average-reward criteria. The second case is a constant discount rate, which leads to a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: The Annals of Probability
سال: 1981
ISSN: 0091-1798
DOI: 10.1214/aop/1176994363